💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference
arxiv.org·15h
🏠Self-hosted AI
Three Solutions to Nondeterminism in AI
blog.hellas.ai·2d·
Discuss: Hacker News
🏗️AI Infrastructure
A small number of samples can poison LLMs of any size
dev.to·16h·
Discuss: DEV
🏠Self-hosted AI
LoRA Explained: Faster, More Efficient Fine-Tuning with Docker
docker.com·1d
🏠Self-hosted AI
RND1: Simple, Scalable AR-to-Diffusion Conversion
radicalnumerics.ai·23h·
Discuss: Hacker News
🏗️AI Infrastructure
Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks
machinelearning.apple.com·1d
🎙️Whisper
SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
arxiv.org·15h
🏗️AI Infrastructure
LLM Optimization Notes: Memory, Compute and Inference Techniques
gaurigupta19.github.io·4d·
Discuss: Hacker News
🏗️AI Infrastructure
The Hidden Oracle Inside Your AI: Unveiling Data Density with Latent Space Magic by Arvind Sundararajan
dev.to·1d·
Discuss: DEV
📱Edge AI
Towards a Typology of Strange LLM Chains-of-Thought
lesswrong.com·21h
🏗️AI Infrastructure
Neuro-Symbolic AI
en.wikipedia.org·4h·
Discuss: Hacker News
🧠Neuromorphic Chips
Evaluating Gemini 2.5 Deep Think's math capabilities
epoch.ai·5h·
Discuss: Hacker News
🏗️AI Infrastructure
Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Management
arxiv.org·1d
🏠Self-hosted AI
Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
arxiviq.substack.com·1d·
Discuss: Substack
🏗️AI Infrastructure
Operationalizing Data Minimization for Privacy-Preserving LLM Prompting
arxiv.org·3d
🏠Self-hosted AI
Show HN: Nanowakeword – Automates custom wake word model training
github.com·7h·
Discuss: Hacker News
🎙️Whisper
Real-Time Adaptive Sparsity Optimization for Edge-Deployed AI Inference Accelerators
dev.to·9h·
Discuss: DEV
🏗️AI Infrastructure
The key to conversational speech recognition
datasciencecentral.com·1d
🎤Voice Interfaces
Expanding the Action Space of LLMs to Reason Beyond Language
arxiv.org·15h
🏗️AI Infrastructure
[D] Anyone using smaller, specialized models instead of massive LLMs?
reddit.com·1d·
Discuss: r/MachineLearning
🌐Distributed systems